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TITLE OF THE INVENTION 

Processor With Annul Under Mask Technology For Improved Branch Efficiency 



CROSS-REFERENCES TO RELATED APPLICATIONS 
Not Applicable. 

5 

STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH OR 
DEVELOPMENT 

Not Applicable. 

10 

BACKGROUND OF THE INVENTION 

The present embodiments relate to processors, and are more particularly directed 
to improving branch efficiency in such processors. 

The present embodiments pertain to the ever-evolving fields of computer 
15 technology, microprocessors, and other types of processors. Processor devices are used in 
numerous applications, and their prevalence has led to a complex and demanding 
marketplace v^here efficiency of operation is often a key consideration, where such 
efficiency is reflected in both price and performance of the processor. Accordingly, the 
following discussion and embodiments are directed to one key area of processor 
20 efficiency, namely, the large prevalence of branch instructions in computer code. 
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The branch instruction arises in many contexts, such as from conditional 
statements in a high-level computer language such as an IF-THEN or IF-THEN-ELSE 
statement or other statments providing the same or comparable fimctionality based on a 
given high level language. The high level conditional statement is compiled or translated 

5 down to a more simple branch instruction at the machine level, such as a jump instruction. 
In any event, each time a branch instruction is encountered in computer code, it represents 
a potential of a change in flow in the operation of the processor. Specifically, if the branch 
condition is met (i.e., if the branch is ''taken''), then the resulting flow change may expend 
numerous processor clock cycles. For example, the current architected state of iiie 

10 processor may have to be saved for later restoration, and the new flow must be initialized, 
such as by fetching instructions at the location of the new program flow. Further 
comphcating the above consequences is the notion that the branch instruction is generally 
accepted to occur relatively often in a statistical sense. For example, in contemporary 
code, a branch instruction may occur on the average of every six instructions. Moreover, 

15 approximately two-thirds of such branches are taken. Still further, tmder current 
standards, it may be estimated that fotir clock cycles are required to effect the taken 
branch. Given these numbers, it is readily appreciated that branch activity can dominate 
the performance of a computer. Indeed, these types of numbers have motivated various 
approaches in the art to reduce the impact of branch inefficiencies, including branch 

20 prediction approaches as well as branch predication (typically referred to simply as 
"predication"). An xmderstanding of the latter further introduces the preferred 
embodiments and, thus, predication is discussed in greater detail below. 

In many computers, and particularly superscalar and very large instruction word 
(" VLIW") computers, compilers attempt to eliminate conditional branches through the use 
25 of predicated instructioris. Predication is implemented in a processor by including 
additional hardware, often referred to as a predicate register, where the state of the 
register is associated with a given instruction. Further, the predicate register provides a 
condition, or "predicate," which must be satisfied if the associated instruction is to be 
executed. In other words, prior to execution of each predicated instruction, its associated 
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condition is tested and, if the condition is met, the instruction is executed; to the contrary, 
if the associated condition is not met, then the instruction is not executed. Given this 
approach, the number of branch instructions may be reduced by instead predicating 
certain instructions based on a condition that otherwise would have been evaluated using 
5 a branch instruction (or more than one branch instruction). 

To further illustrate predication and also as an introduction to a convention to be 
used later to further demonstrate the preferred embodiments, below is provided a list of 
pseudo code which represents a typical IF-THEN-ELSE sequence: 

IFA1 
10 THEN 

INSTR 1 
INSTR3 

ELSE 

INSTR 2 

15 INSTR 4 

END 

As will be evident to one skilled in the art, the above-listed code tests condition Al 
and, if it is satisfied (i.e., is true), then the instructions following the ''THEN'' path 
(ie,, instructions 1 and 3) are executed to complete the code, whereas if condition Al is not 
20 satisfied (i.e., is false), then the instructions following the "ELSE" path (i.e., instructions 2 
and 4) are executed to complete the code. 

By way of further introduction, the above-listed pseudo code is illustrated using a 
tree diagram in Figure la. Turning to Figure la, it illustrates an instruction group Gl 
forming a single condition tree, where that condition is the result of Al condition and, 

25 thus, the condition Al is shown at the top of the tree. Further, the instructions to be 
executed based on the result of the condition are shown as branches of the tree. 
Particularly, if Al is true, then the instructions along the branch or path below and to the 
left of the tree are executed (as shown with the label "THEN"), whereas if Al is false, then 
the instructions along the branch or path below and to the right of the tree are executed (as 

30 shown with the label "ELSE"). Once the bottom of the tree is reached, the code is 
complete. 
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Given the pseudo code above and its tree illustration in Figure la. Figure lb 
illustrates in diagram form the nature in which predication may be applied to that code. 
Specifically, Figure lb illustrates each instruction in the tree as a row entry, shown 
generally in a box to suggest some type of storage or access to each instruction. Further, 
5 each accessible insfanction is associated with the condition of Al, where the specific 
condition is shown in Figure lb by placing the condition in the same row entry as the 
corresponding instruction. For example, the first row in Figure lb illustrates the instance 
where condition Al is true as associated with instruction 1. As another example, the 
second row in Figure lb iUustrates the condition of Al being false (shown as Al ). Given 

10 the association of instruction and corresponding condition of Figure lb, prior to each 
instruction being executed its associated condition is tested and the instruction is executed 
only if the condition is satisfied. Lastly, note that the illustration of Figure lb is for 
background purposes, and is not intended as an actual representation of the manner in 
which predication may be achieved in hardware. Indeed, in many contemporary 

15 processor architectures it is the case that an entire control word referred to as a predicate 
field is associated with each instruction; for example, the predicate field may include three 
bits, where seven of the possible bit combinations of those three bits identify 
corresponding registers (e.g., general purpose registers) storing different predicates, while 
the eighth binary combination simply indicates that the present instruction is not 

20 predicated. 

While predication has reduced the inefficiencies of branch instructions, it also 
provides various drawbacks. As a first example of a predication drawback, predication is 
generally not an acceptable solution for long blocks of code. A block of code is defined for 
this purpose as a group of instructions which are executed sequentially and where there 
25 are no branch instructions within the group (although the group may end with a branch 
instruction). More particularly, in the case of a large block, if each instruction in the block 
is predicated with the same condition, ihen the additional resources required to test the 
predicate for each instruction in the block may easily outweigh fee penalty which would 
occur if the entire block were conditioned at its outset by a single branch instruction. As a 
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result, there is a trade-off between using predication and branch instructions based on the 
number of instructions in a given block. Typically, the limit of the number of instructions 
in a group may be empirically determined. For example, in a processor where a branch 
instruction uses five delay slots and with the branch instruction itself reqtiires six cycles of 

5 execution, and further if the processor is superscalar and can execute up to eight 
instructions per cycle, then it may be useful to predicate instructions for blocks only up to 
48 instructions. Stated generally, therefore, predication is more efficient for what may be 
referred to relatively as short blocks of instructions. Even with this constraint, virtually all 
modem microprocessors implement some type of predication. As a second example of a 

10 predication drawback, many contemporary processors provide up to only a single 
predicate bit per instruction. Accordingly, such an approach is limited to only a single 
level condition as in the case of Figure la. However, if an instruction is associated with 
more than one condition, as will be explored in greater detail later, then the additional 
conditions cannot be imposed on the instruction using predication and, instead, the 

15 instruction must then often be handled using branch instructions which give rise to the 
inefficiencies described earlier. 

In view of the above, the present inventor has recognized the above considerations 
and drawbacks and below presents unproved embodiments wherein the high overhead 
penalty of branch instructions is considerably reduced. 
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BRIEF SUMMARY OF THE INVENTION 

The preferred embodiment includes a processor having a changeable architected 
state. The processor includes an instruction memory for storing instructions. The 
processor also includes an instruction pipeline, where an instruction which passes entirely 
through the pipeline alters the architected state. Further, the pipeline comprises circuitry 
for fetching instructions from the instruction memory into the pipeline. The processor 
also includes circuitry for storing an annul code corresponding to instructions in the 
pipeline. Finally, the processor includes circuitry for preventing one or more selected 
instructions in the group from altering the architected state in response to the annul code. 
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BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

Figure la illustrates a tree diagram of an instruction group with a single condition 
at a single level; 

Figure lb illustrates the non-conditional instructions of Figure la and predicated 
5 by the conditional instruction of Figure la; 

Figure 2a illustrates a tree diagram of an instruction group with a conditions at 
two levels; 

Figure 2b illustrates the instruction group of Figure 2a and a corresponding annul 
word in accordance with a preferred embodiment; 

10 Figure 2c illustrates the annuls word of Figure 2b with its values set in the instance 

where condition A2 is true; 

Figure 2d illustrates the annuls word of Figure 2b with its values set in the instance 
where condition A2 is false; 

Figure 3a illustrates a preferred method for setting the states of the elements in the 
1 5 annul word of Figure 2b, where liie states are shown as set in Figures 2c and 2d; 

Figure 3b illustrates a method in accordance with the preferred embodiment for 
processing an instruction group with two or more condition levels and for setting the 
states of the elements in a correspond annul word; 

Figure 4a iUustrates the predication step of the preferred embodiment taken with 
20 respect to the iitstruction tree in Figure 2a when condition A2 is true; 

Figure 4b illustrates the predication step of the preferred embodiment taken with 
respect to the instruction tree in Figure 2a when condition A2 is false; 

Figure 5a illustrates a tree diagram of an instruction group with a conditions at 
three levels; 
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Figure 5b illustrates the instruction group of Figure 5a and a corresponding annul 
word with its values set in the instance where condition A3 is true; 

Figure 5c illustrates the instruction group of Figure 5a and a corresponding annul 
word with its values set in the instance where condition A3 is false; 

Figure 5d illustrates the instruction group of Figure 5a and a corresponding annxil 
word with its values set in the instance where condition A3 is true and condition B3 is 
true; 

Figure 5e illustrates the instruction group of Figure 5a and a corresponding annul 
word with its values set in the instance where condition A3 is true and condition B3 is 
false; 

Figure 5f iUustrates the instruction group of Figure 5a and a corresponding annul 
word with its values set in the instance where condition A3 is false and condition C3 is 
true; 

Figure 5g iUustrates the instruction group of Figure 5a and a corresponding annul 
word with its values set in ihe instance where condition A3 is false and condition C3 is 
false; 

Figure 6a illustrates an electrical functional diagram of tiie preferred embodiment 
for using bits from the annul word to generate an annul mask used to prevent execution of 
instructions identified to be anntilled; 

Figure 6b iUustrates the electrical functional diagram of Figure 6a witfi tiie annul 
mask and use map being set according to a first packet of instructions scheduled for 
execution; 

Figure 6c iUustrates the electrical functional diagram of Figure 6a with the annul 
mask and use map being set according to a second packet of instructions scheduled for 
execution; 
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Figure 6d illustrates the electrical functional diagram of Figure 6a with the annul 
mask and use map being set according to a third packet of instructions scheduled for 
execution; 

Figure 7 illustrates an instruction stream having three packets of instructions, 
5 where each instruction has a corresponding functional unit to which it will be mapped as 
well as a bit from an annul word to indicate whether the instruction is to be annulled; 

Figure 8 illustrates a prior art example of software pipelining; 

Figure 9 illustrates the application of annul words to greatly reduce the number of 
instructions required to implement tiie software pipelining example of Figure 8; and 

0 Figure 10 illustrates a preferred embodiment of a processor implementing the 

circuit, systems, and methods illustrated by the preceding Figures. 
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DETAILED DESCRIPTION OF THE INVENTION 

Figures la and lb were described above in the Background Of The Invention 
section of this doctunent. 

To demonstrate the preferred embodiments by way of a first example, Figure 2a 
5 illustrates a tree diagram illustrating the logical order of a group of instructions G2, where 
group G2 includes multiple levels of conditional instructions; more particularly, in the 
example of Figure 2a, there are two levels of instructions, where the first level consists of 
condition A2, while the second level consists of conditions B2 and C2. The remaining 
structure of the Figure 2a tree diagram may be readily appreciated given the introduction 
10 provided by Figure la, above, and is further illustrated by the following pseudo code 
which gives rise to the tree diagram of Figure 2a: 

IFA2 

THEN 

INSTR 1 
15 IF B2 

THEN 

INSTR 3 
INSTR 7 

ELSE 

20 INSTR 4 

INSTR 8 

ELSE 

INSTR 2 
IFC2 

25 THEN 

INSTR 5 
INSTR 9 

ELSE 

INSTR 6 

30 INSTR 10 

END 

The above code tests at the first level condition A2 to determine if it is true. If 
condition Al is satisfied, then the flow is directed to instruction 1 and then proceeds to a 
condition B2 at the second level. If condition A2 is not satisfied, then the flow is directed 
35 to instruction 2 and the proceeds to a condition C2 at the second level In addition. 
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following each of conditions B2 and C2 at the second level, the flow will continue to the 
instructions shown in the tree diagram below and to the left of a given condition if it is 
met, or to the instructions below and to the right of a given condition if it is not met. For 
example with respect to condition B2, if it is met, the flow proceeds with instructions 3 and 
5 7, whereas if condition B2 is not met, the flow proceeds with instructioiis 4 and 8. The 
remaining possibiHties wiH be ascertainable by one skilled in the art. Finally, note that the 
two different levels of group G2 prevent it from being completely processed by a one bit 
predication system as described earlier in connection with the prior art. In other words, in 
a one bit predication system, if condition Al is tested and used to establish a predicate bit, 
1 0 then conditions B2 and C2 still must be tested. 

Figure 2b illustrates a logical depiction of a first aspect of the preferred 
embodiment. More particularly. Figure 2b first illustrates the instructions of group G2 as 
also shown in the tree diagram of Figure 2a, where it should be understood that these 
instructions may be represented in various manners in a processor according to various 
15 different implementations of the present embodiments. For example, such instructions 
may be pending in a pipeline or stored in a register file or the like. In any event, the 
preferred method as described below assumes access to some type of stored 
representation of instructions forming at least a two level conditional tree such as that 
shown in Figure 2a. 

20 Also illustrated in Figure 2b is an additional storage device, which for reasons 

more clear below is referred to in this document as an annul word. In the preferred 
embodiment an annul word includes binary elements corresponding to instructioris in a 
given instruction group. For example, in the iUusfa-ation of Figure 2b, an annul word AWl 
is shown with N elements identified Eli through EIn, where the "1" in the El indicator is 

25 used to associate the element with annul word AWl and the subscript simply increments 
from one end of the word to the other. Each of elements Eli through EIn corresponds to 
an instruction in group G2 along the same row in Figure 2b. Note also in this regard that a 
condition is considered a type of instruction and, therefore, each condition also has an 



11 



TI-26581 



PATENT 



associated element in annul word AWl. In all events, as examples of this alignment 
element Elo corresponds to instruction 1, element Eli corresponds to instruction 1, 
element EI2 corresponds to instruction (and condition) B2, and element Elu corresponds 
to instruction 10. Further and as explained later, note fcat no element corresponds to the 
5 instruction at the top of group G2 (i.e., instruction Al). Finally, given the discussion thus 
far and the additional detail in the remainder of this document, one skilled in the art will 
appreciate that an annul word may be performed using various storage or state devices, 
where a register may be used by way of a example. 

Figure 3a illustrates a simplified flow chart of a method 10 in accordance vdfh the 
10 preferred embodiment where method 10 is preferably performed by a compiler and sets 
tiie states of aimul word AWl from Figure 2b; indeed and as detailed later, in the 
preferred embodiment method 10 is repeated to form two different annul words which 
ui; are complements of one another. To appreciate method 10, its steps axe first explored 

''% followed by some examples of its application in the context of instruction group G2. 
=P 15 Meihod 10 begins with a step 12 that assumes a condition outcome in an instruction 
group, where the first condition analyzed is that which is at the top of the group. For 
f'"^ example with respect to group G2, method 10 begins with condition A2, In the first 

H^-- instance of step 12, condition A2 is assumed to be true and method 10 continues to step 14 
which, for a first annul word, sets the annul word bits for each instruction along the 
■:3 20 "ELSE'' path of the instruction group. After step 14, the flow returns to step 12 at which 
point the condition (e.g,, A2) is assumed to be false. In response to the false assumption, 
method 10 continues to step 16 which, for a second annul word, sets the annul word bits 
for each instruction along the 'THEN" path of the instruction group. Each of the 
alternatives provided by steps 14 and 16 is further explored below. Before reaching those 
25 alternatives, note by way of introduction to another aspect of the preferred embodiment 
that once a bit is set in the annul word, then the instruction corresponding to the set bit is 
later annulled, that is, it is suppressed so that the instruction does not alter the architected 
state of the processor. The annulment may be achieved in various manners as also further 
addressed later. Finally, note that to the extent that specific circuitry is not described in 
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this document, method 10 may be implemented by various circuits and operations as may 
be ascertained by one skilled in the art and may be a part of various different types of 
processors. 

Figure 2c again illustrates instruction group G2 and annul word AWl of Figure 2b, 
5 but now further illustrates the states of the binary elements as set according to method 10 
when condition A2 is assumed to be true. Specifically, if condition A2 is asstimed to be 
true, then in step 14 the compiler sets the bits in annul word AWl corresponding to each 
instruction along the "ELSE" path of instruction group G2; from the tree diagram of 
Figure 2a, it may be confirmed that the instructions along tiie ELSE path are instructions 2, 

10 C2, 5, 6, 9, and 10. Accordingly, in Figure 2c, note that elements EI2, EI4, EI7, Elg, Elu, and 
EI12 are set since they correspond to instructions 2, C2, 5, 6, 9, and 10. Given the states of 
the bits in annul word AWl of Figure 2c, then in the preferred embodiment instructions 2, 
C2, 5, 6, 9, and 10 are not permitted to alter the architected state of the processor. Indeed, 
as shown in the preferred embodiment later, tiiese instinictions are not permitted to 

15 execute. Moreover, as also appreciated later, the operation provided by the preferred 
embodiment as an alternative to branch instinictions avoids the delays and 
unpredictabiHty associated with branch operation, and also does not compHcate or 
prohibit the scheduling of instructions following a branch instruction as is often the case 
when branching is used. Still further, therefore, note that condition C2 is one of the 

20 suppressed instructions and, as a condition, it is not tested. Thus, there is a reduced 
processor burden as compared to a one bit predication system as described earlier. 

Figure 2d again illustrates instruction group G2 and annul word AWl of Figure 2b, 
but Figure 2d illustirates the states of the binary elements as set by the compiler according 
to metiiod 10 when condition A2 is assimied to false. SpecificaUy, if condition A2 is 
25 assumed to be false, then step 16 sets the bits in annul word AWl corresponding to each 
insfaiiction along tiie "THEN" patii of instiiiction group G2; from the tree diagram of 
Figure 2a, it may be confirmed that the instiructions along tiie THEN path are instioictions 
1, B2, 3, 4, 7, and 8. Accordingly, in Figure 2d, note that elements Eli, EI3, EI5, Ele, EI9, 



13 



TI-26581 



PATENT 



and Elio are set since they correspond to instructions 1, B2, 3, 4, 7, and 8. Given the states 
of the bits in annul word AWl of Figure 2d, then in the preferred embodiment 
instructions 1, B2, 3, 4, 7, and 8 are not permitted to alter the architected state of the 
processor. Further, because these instructions are preferably not executed by the 
5 processor, and because these non-executed instructions include tiie complexities arising 
from testing and responding to condition B2 which is not tested, then the delays and 
complexities of testing and responding to a branch instruction are not incurred. 

Figure 3b illustrates a flow chart of a method 20 in accordance wifli the preferred 
embodiment where method 20 is preferably performed by a compiler, and which as 

10 demonstrated below includes the steps of method 10 of Figure 3a and again operates to 
determine the bit states for various annul words. Method 20 begins with a start step 22 
which simply depicts the examination of a flow of instructions, where the instructions 
may be perceived by way of example as instruction group G2. Step 24 is reached when an 
instruction in the sequence is detected to be a condition. In response, method 20 continues 

15 to step 26, which determines whether the condition detected in step 24 is already annulled 
in the given annul word being estabhshed, that is, whether the condition corresponds to a 
set bit in that anntd word; if the detected condition has been annulled, then method 20 
returns to step 22 after which another condition may be detected, whereas if the detected 
condition has not been annulled, then method 20 continues to step 28. 

20 Step 28 determines whether the condition detected in step 24 is at a bottom level 

for the given instruction tree. If the detected instruction is at the bottom of the tree, 
method 20 continues to step 30 whereas if the detected instruction is not at the bottom of 
the tree, method 20 continues to step 12. Returning briefly to Figure 2a, the operation of 
step 28 may be shown by way of example. SpecificaUy, step 28 determines, for an 

25 instruction having been reached and not annulled (as will be excluded by step 26), that 
either of instruction B2 or C2 are at the bottom of the instruction tree. As a result, for such 
an instruction, metiiod 20 continues to step 30, and step 30 predicates the instruction 
where the predication is in the same manner as the prior art. To further iUustrate this 
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operation, Figttres 4a and 4b illustrate in diagram form the nature in which predication 
may be applied to these instructions, where such a form may be embodied using a 
predicate register or the like. Briefly looking at these Figures, Figure 4a illustrates the 
predicate formation for instruction B2 while Figure 4b illustrates the predicate formation 
5 for iiistruction C2. In Figure 4a, therefore, it is demonstrated that if instruction B2, as a 
condition, tests true, then instructions 3 and 7 are to be executed, whereas if instruction B2 
tests false, then instructions 4 and 8 are to be executed. Similarly in Figure 4b, it 
demonstrates that if instruction C2, as a condition, tests true, then instructions 5 and 9 are 
to be executed, whereas if instruction C2 tests false, then instructions 6 and 10 are to be 
10 executed. Each of the indications of Figures 4a and 4b may be readily confirmed from the 
tree structure of Figure 2a. 

To further demonstrate the preceding, an example is now traced through the steps 
of method 20. Method 20 begins by processing instructions in group G2 with step 22, and 
detects condition A2 at step 24. Step 26 evaluates whether condition A2 has been 

15 annulled; at this point, however, no annulling has taken place with respect to group G2 
and, thus, the flow continues to step 28. Next, step 28 determines whether condition A2 is 
at the bottom of the tree and, since it is not, the flow continues to step 12. Step 12 first 
assiunes that the outcome of condition A2 is true and, accordingly, the flow continues to 
step 14 to set the bit states in a first annul word so that those bits along the "ELSE"' path 

20 are set to one; in other words, therefore, step 14 sets the elements to appear as they are 
shown in Figure 2c. Next, the flow returns again to step 12 which next assumes that 
condition A2 is false. In response, method 20 continues to step 16 which, for a second 
annul word, sets the annul word bits for each instruction along the 'THEN'' path of the 
instruction group; in other words, therefore, step 16 sets the elements to appear as they are 

25 shown in Figure 2d. Each of the alternatives provided by steps 14 and 16 is further 
explored below, and in any event once step 16 is complete the flow returns to step 22, as 
also further explored below. 
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After processing condition A2 and returning to step 22, step 24 detects condition 
B2 and proceeds to step 26 which evaluates whether the detected condition (i.e., B2) is 
annuUed for a given annul word being formed. For example, assume that annul word 
AWl in Figure 2d illustrates the current word being formed. Accordingly, it may be seen 
in Figure 2d that indeed condition B2 is annulled as indicated by the set state of element 
EI3. As a result, the flow continues from step 26 back to step 22, and proceeds still further 
as explored below. 

Step 22 continues the process after having already detected conditions A2 and B2, 
and step 24 is next reached when condition C2 is detected. Next, step 26 examines 
whether condition C2 is annulled, and again given that the present example is reflected by 
annul word AWl in Figure 2d, the cleared state of element EI4 indicates that condition C2 
is not annuUed. As a result, method 20 continues to step 28. Step 28 determines that 
condition C2 is a bottom level condition and passes the flow to step 30, which predicates 
the instructions that follow condition C2 in the tree. Accordingly, step 30 creates the 
predicate information illustrated in Figure 4b, and method 20 concludes with a stop step 
32. Lastly, while not expressly shown in Figure 3b, one skilled in the art should appreciate 
that in the preferred embodiment method 20 repeats to form each different possible annul 
word based on the possible outcomes (i.e., either true or false) for all conditions which are 
not at the bottom level of the tree. 

While the preferred embodiment has now been illustrated as appUed to the two 
level instruction group G2 of Figure 2a, it should be appreciated that it also appHes to 
instruction groups with more than two levels. To further illustrate this aspect. Figure 5a 
illustrates a tree diagram iUustrating the logical order of a group of instructions G3, where 
group G3 includes three levels of conditional instructions. Given the earlier-provided 
discussion, a detailed statement regarding each instruction in group G3 is not necessary as 
one skilled in the art should appreciate the sequence as demonstrated in Figure 5a. 
Briefly, therefore, group G3 begins with a first level condition A3, and below it is a second 
level set of conditions B3 and C3, below which is a third level set of conditions D3, E3, F3, 
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and G3. As with the earlier tree convention in this document, if a condition is assximed to 
be satisfied then the flow continues to the bottom left of the condition whereas if the 
condition is not satisfied then the flow continues to the bottom right of the condition. 

To further illustrate the use of an annul word according to the preferred 
5 embodiment/ Figures 5b through 5g illustrate the values in an annul word AW2 which are 
set by method 20 in response to different findings with respect to the tested conditions of 
Figure 5a. A few of these Figures are now explored in detail, from which one skilled in the 
art should readily appreciate the comparable results in the remaining Figures, 

Figure 5b illustrates instruction group G2 along with its corresponding annul word 

10 as set by method 20 when condition A3 is assumed to be true. More particularly, when 
method 20 operates with respect to group G2, step 24 detects condition A3, and since it is 
not annulled then step 26 passes the flow to step 28 which advances the flow to step 12 
because instruction A3 is not a bottom level instruction. Step 12 assimnes that condition 
A3 is true (in itie example of Figure 5b), and next therefore step 14 sets each element in 

15 annul word AW2 corresponding to the "ELSE" path of group G2. Thus, with respect to 
Figure 5a, step 14 sets each element in aimul word AW2 corresponding to an instruction 
along the path below and to the right of condition A3, and from Figure 5b it will be shown 
fliat these set elements correspond to instructions 2, C3, 5, 6, F3, G3, 11, 12, 13, 14, 19, 20, 
21, and 22. These set bits wiU eventually cause these instructions to be annulled, and note 

20 that the annulled instructions include three conditions (i.e,, C3, F3, and G3). Since these 
conditions are annulled then there is no additional processor burden required for testing 
these conditions and acting in response to the test. Lastly, Figure 5c illustrates instruction 
group G2 along with its corresponding annul word as set by method 20 when condition 
A3 is assumed to be false and, from the preceding, one skilled in the art should appreciate 

25 that its annul word states are complementary to those shown in Figure 5b, thereby 
anntdling the instructions along the path below and to the left of condition A3. 

Figure 5d illustrates instruction group G2 along with its corresponding anntd 
word as set by method 20 when condition A3 is assumed to be true and condition B3 is 
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also assumed to be trae. Specifically, recall that method 20, after a first instance of either 
step 14 or 16, returns to process the next condition. Thus, for the example of Figure 5d 
when condition A3 is first assumed to be true, then the next instance of step 24 detects 
condition B3. Next, step 26 determines whether condition B3 is annulled, and this 

5 determination is made by referring to annul word AW2 of Figure 5b which corresponds to 
the present example where condition A3 is assumed to be true; from this analysis, it is 
determined that condition B3 is not annulled and, thus, step 26 passes the flow to step 28. 
Since condition B3 is not a bottom level condition, then step 28 passes the flow to step 12. 
In the example of Figure 5b, condition B3 is also assumed to be true, so the operation of 

10 step 12 passes the flow again to step 14, which now sets the bits in annul word AW2 with 
respect to the instructions below condition B3. Thus, in addition to those bits that were set 
earlier when condition A3 was processed, and given that step 14 is now operating with 
respect to condition B3 which is assumed to be true, then step 14 sets the bits in armul 
word AW2 corresponding to those instructions along the patti below and to the right of 

15 condition B3. Accordingly, Figure 5d illustrates that, in addition to the same set bits as 
shown for condition A3 being true from Figure 5b, the bits corresponding to instructions 
4, E3, 9, 10, 17, and 18 are also set. 

Flaving presented the above examples, one skilled in the art may readily trace 
though and confirm the remaining bit illustrations for Figures 5e through 5g, where each 

20 such Figure illustrates a different application of method 20 given the assumptions taken 
by step 12 , In this regard, these remaining Figures illustrate the following: (1) Figvu'e 5e 
illustrates the values of annul word AW2 when condition A3 is assumed to be true and 
condition B3 is assumed to be false; (3) Figure 5f illustrates the values of annul word AW2 
when condition A3 is assumed to be false and condition C3 is asstimed to be true; and (4) 

25 Figure 5g illustrates the values of annul word AW2 when condition A3 is assumed to be 
false and condition C3 is assumed to be false. In each of these examples, therefore, and as 
weU as in Figure 5b, note that by time the second level condition is processed by method 
20, a total of 20 of the total instructions in group G3 are annulled. Thus, these instructions 
may pass through a portion of the processor pipeline, but they do not have the 
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inefficiencies associated with them as would be the case if branch instractions were 
instead used to implement the tree. FinaUy, one skilled in the art should also appreciate 
that based on the true or false values of the upper level conditions (i.e., A3, B3, and C3), 
ultimately method 20 wiU converge on a selected one of the four lowest level conditions 
and predicate the remaining instructions below that selected condition. As a result, there 
is additional processing efficiency obtained with respect to the instruction(s) foUowing the 
lowest level condition. 

Having detailed the preferred embodiment for establishing an annul word, 
attention is now directed to tiie use of the annul word bits to suppress the instruction(s) 
designated by that word so that the suppressed or "annulled" instructions do not change 
the architected state of the processor, as is now explored first in connection with Figure 6a. 
By way of introduction. Figure 6a iUustrates a diagram of an instruction suppression 
system 40. System 40 may be implemented using various different circuits, while Figure 
6a therefore demonstrates the logical functionaHty that is desirable in the preferred 
embodiment. Moreover, as noted earUer with respect to the preferred methodology of 
detecting conditions and setting states in an annul word, system 40 may be implemented 
in various different types of processors. 

Turning now to the details of system 40, it includes an annul word, which to 
distinguish from earher examples is designated as AW3. In the preferred embodiment, 
annul word AW3 includes a sufficient number of bit elements to accommodate a desirable 
nxunber of instructions in the instruction sequence. For example, under current 
architectures, a desirable size may be 32 instructions and, thus, as shown in Figure 6a, 
annul word AW3 includes 32 bit elements E3i through E332. The states of annul word 
AW3 are connected to a first data input of a buffer 42 which has a second input connected 
to the output of a shift register 44. Shift register 44 has a shift capabiHty equal in size to the 
number of bits stored by annul word AW3 and, hence, in the current example, shift 
register 44 is a 32-bit shift register. The shift control input of shift register 44 receives a 
control signal designated NIP, which is an abbreviation for number of instructions in 
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packet, as will be detailed later. The output of buffer 42 provides a bit group 46. In this 
regard, note that bit group 46 is referred to in this manner so as to radicate that certain bits, 
as detailed below, are used from the output of buffer 42, but these bits need not be stored 
in yet another separate device which could otherwise complicate the design and add 
5 delay. The nxmiber of bits in bit group 46 is the same number of bits which are in annul 
word AW3 (i.e., 32 in the present case). The 32 bits of bit group 46 are coupled in a 
marmer such that fhey are fed back to a second input of shift register 44, and also such that 
an integer number M of the least significant of these 32 bits are used as an annul mask 
AM. Anntil mask AM also represents a group of bits rather than a separate hardware 
10 device, but for sake of illustration these M bits are shown in Figure 6a as AMi through 
AMm. Finally, the bits of anntd mask AM are coupled to a functional xmit use map 48 
which, as detailed below, is written by the compiler to map one or more bits from annul 
mask AM to the appropriate one of Ihe eight functional units FUi through FUg. 

Before discussing the operation of system 40, note that the processor in which it is 
15 implemented is also understood to have the integer M number of ftmctional xmits. A 
ftmctional tmit may be one of various different types of devices, where typically in the art 
it is these units that are said to ''execute" a corresponding instruction. Also in this regard, 
it is often stated that these units make up the "execution stage'' of the processor. By way 
of example, assume Aat M equals eight as shown in Figure 6a, that is, a processor 
20 implementing system 40 according to the preferred embodiment includes eight functional 
units. For example, these units may include two load/ store tmits, two mtdtiply units, two 
ALU operation (e.g., add, subtract, and logical) tmits, and two shift tmits. This example 
will be carried forward below to explain the preferred manner in which the elements in 
annul mask AM are used to either enable or disable the execution operation of each of 
25 these eight functional units. 

By way of further introduction to the operation of system 40 of Figure 6a, Figure 7 
illustrates the instructions in group G3 (from Figure 5a) as they have been scheduled by a 
compiler and according to an order detailed later. Aligned with each instruction in the far 
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right coltunn is an example of a state of a corresponding bit in annul word AWl (from 
Figure 2c); thus, in the present embodiment, the annul word bit effectively travels with the 
corresponding instruction. Further illustrated in Figure 7 in the far left coltunn is an 
indication of the functional unit which is to execute tiie corresponding instruction. For 

5 example, instruction 1 is assigned to be executed by functional unit FUi, instruction 2 is 
assigned to be executed by functional unit FU2, and so forth. Note that assignment by a 
compiler of an instruction to a functional unit in this regard is known in the art, but the 
addition of the use and implementation of the annul word and related functionality 
described herein improves that known implementation. An additional concept illustrated 

10 by Figure 7 is the notion of instruction packets, where a packet is defined as a group of 
instructioris scheduled to be executed by corresponding functional units in a single clock 
cycle. For example, a first packet Pi consists of instructions 1 and 2 and, thus, those two 
instructions are scheduled to be executed in a single clock cycle. As another example, a 
second packet P2 consists of instructions 3, B2, 4, and C2 and, thus, those four instructions 

15 are scheduled to be executed in a single clock cycle. Since the processor discussed by way 
of example includes eight fimctional tmits, then one skilled in the art should appreciate 
that a packet for tiiat processor may include up to eight corresponding instructions. 

Returning now to system 40 of Figure 6a, its operation is described given the 
additional context provided by Figure 7. Assume initially that annul mask AM is reset to 

20 zeroes. Assume further by way of example that at a given time after reset, annul word 
AW3 in Figure 6a includes the bit states of the annul word AWl from Figure 7, and 
assume that such bits have been aligned by the compiler in annul word AW3 in the same 
order as illustrated in Figure 7, such that the annul bit state for instruction 1 is located at 
element E3i, instruction 2 is located at element E32, and continuing through the sequence 

25 so that the bit state for the last instruction, instruction 10, is located at element E3i2. 
Accordingly, at this time, all bits of annul word AWl from Figure 7, as stored as anntil 
word AW3 from Figure 6a, are output to buffer 42, and provided by buffer 42 as bit group 
46. Additionally, the eight (i.e., M=8) least significant bits (LSBs) from bit group 46 form 
tile bits of annul mask AM, that is, the bits from elements E3i through E38 and as 
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originally stored in annul word AW3, are transferred to become bits in bit group 46 and, 
hence, output as bits AMi through AMs, respectively. Finally, note that the present 
example is simplified in that annul word AW3 is being illustrated as only partiaUy fiUed 
because instruction group G3 has only 12 instructions, whereas annul word AW3 may 
5 accommodate up to 32 bits corresponding to a larger block having up to 32 instructions. 
Also in this regard, it is assumed for reasons apparent later that any upper significant bits 
of annul word AW3 that did not originally include a bit corresponding to an instruction 
are reset to zero. 

Figure 6b further illustrates the set up as described above, and demonstrates the 
1 0 operation for the next dock cycle of the processor including system 40. First, in Figure 6b, 
annul mask AM is shown to store the eight least significant bit values from annul word 
AWl in Figure 7 and, thus, these values correspond to the two instructions of packet Pi, 
the four instructions of packet P2, and two of ttie instructions from packet P3. Figure 6b 
also illtistrates the values written by the compiler into functional unit use map 48 in order 
1 5 to properly map one or more bits from annul mask AM to the appropriate corresponding 
functional unit. More particularly, in the preferred embodiment, the functional units are 
given a defined ordering. This ordering is demonstrated by example here according to the 
subscripts for the functional tmit, that is, they are ordered in ascending fashion from FUi 
to FUs, and each ordered unit corresponds to a location 48i through 488 in use map 48. As 
20 shown below, this ordering is used in the setting of bits in use map 48. 

Before completing the discussion of Figure 6b and having now introduced the 
notion of ordered functional units, note in the preferred embodiment that the compiler 
also is responsible for ordering the annul mask bits according to the ordering of the 
functional units, and this ordering requirement is illustrated in the order set forth in 
25 Figure 7. More particularly, note that the annul word bits of annul word AWl (and the 
corresponding instructions) in Figure 7 do not follow the same sequence as they were 
described earlier, and it is now noted that they have been re-ordered according to the 
preferred embodiment. Specifically, given the annul word bits AWl as introduced earher. 
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the compiler preferably locates those bits in annul word AW3 of Figure 6b in a successive 
order whereby the first (i.e., least significant) ordered annul word bit corresponds to the 
instruction scheduled to be executed by the lowest numbered functional unit, and so forth 
for higher numbered imits. For example, in packet Pi, the instruction scheduled to be 
5 executed by the lowest numbered functional imit is instruction 1, which is to be executed 
by functional xuiit FUi and, thus, its annul bit is shown in the top row in Figure 7. As 
another example, in packet P2, the instruction scheduled to be executed by the lowest 
numbered functional unit is instruction 3, which is scheduled to be executed by functional 
unit FUi and, thus, its annul bit is shown as the first annul bit for packet P2 in Figure 7. 
10 Continuing with the example of packet P2, the instruction scheduled to be executed by the 
next highest niunbered functional unit after functional tmit FUi is instiiiction B2, which is 
scheduled to be executed by functional tmit FU2 and, thus, its annul bit is shown as the 
second annul bit for packet P2 in Figure 7. One skilled in the art will appreciate this aspect 
for the remaining ordering in Figure 7. 

15 Returning now to Figure 6b, in the preferred embodiment and for a given clock 

cycle the compiler writes a one into each location of use map 48 which corresponds to a 
functional unit that is assigned an instruction to execute for the current cycle. By way of 
example. Figure 6b illustrates the states of use map 48 for the cycle to execute packet Pi, 
which recall includes two instructions. Thus, the compiler writes two logic ones into use 

20 map 48, each corresponding to one of the two instructions in packet Pi. Further, the 
location of the ones in use map 48 correspond to the functional tinits assigned to the 
respective instiiictions. For example, use map location 48i is set to one so that the least 
sigiuficant bit from annul mask AM (i.e., AMi) is mapped to functional unit FUi; thus. 
Figure 6b iUustrates an arrow mapping the annul mask bit value 0 from AMi to fimctional 

25 unit FUi. As another example, use map location 485 is set to one so that bit AM2 from 
annul mask AM is mapped to functional tmit FU5; thus. Figure 6b iUustrates an arrow 
mapping the anntd mask bit value 1 from AM2 to functional unit FU5. As a result of the 
preceding, at this time the corresponding bit states of the anntd word have been provided 
to annul mask AM, and \hese states are mapped from annul mask AM to the 



23 



TI-26581 



PATENT 



corresponding functional units identified in Figure Z Indeed, note further that this 
preferred mapping functionality has been facilitated in part by the previously-described 
preferential operation whereby the annul bits were put in an order that corresponds to the 
ordering of the functional units. Lastly, note that the embodiment operation just 
5 described causes only a number of bits from the annul mask equal to the nimnber of 
instructions schedtded to be executed to map to appropriate functional xmits, where in the 
just-described example only two annul mask bits were mapped to functional units; as a 
result, in the present clock cycle the remaining bits in annul mask AM have no effect on 
processor execution. 

10 Once the instructions and annul mask bits are received by the respective functional 

tmits, then each tmit operates in response to the state of its received annul mask bit. 

'S3 Specifically, if the annul mask bit is clear (i.e., "0"), the functional xmit executes its 
corresponding instruction. However, if the aimul mask bit is set (i.e., ''1''), then the 

'"Z functional tmit does not execute its corresponding instruction - this may be accomplished 
15 merely by disabling the fimctional tmit during the current clock cycle. By preventing the 
execution of the instruction, the preferred embodiment annuls the instruction, that is, the 
instruction is suppressed and does not cause any change in the architected state of the 
processor. To further illustrate these two alternatives, consider again the example of 
packet Pi, as illustrated in Figure 6b. In this case, functional unit FUi has received 

^3 20 instruction 1 and its anniil mask bit state of 0. Accordingly, functional tmit FUi executes 
instruction 1. To the contrary, functional unit FU2 has received instruction 2 but its armul 
mask bit state is 1; thus, functional tmit FU2 does not execute instruction 2. 

Also during the clock cycle in which the instructions of packet Pi are potentially 
executed (i.e., based on the state of their corresponding annul word bits), system 40 
25 provides to shift register 44 the number of instructions in the packet (NIP) value, where it 
now may be explained that this number identifies the number of instructions in the packet 
which during the current clock cycle was forwarded to one or more fimctional units. 
Again by way of example for packet Pi, then NIP equals two (i.e., for instructions 1 and 2). 
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In addition, recaU that shift register 44 has a feedback input from bit group 46. 
Accordingly, shift register 44 had previously input the annul mask bits provided by bit 
group 46, which in the current example is all of the annul bits earKer provided by annul 
word AW3 and corresponding to instruction group G3 in its entirety. Next, shift register 
44 shifts out NIP bits at its least significant end and which tfierefore correspond to the 
oldest pending instructions. In addition, and for reasons explained below, shift register 44 
shifts in NIP bits have a value of zero into its most significant locatlon(s). Thtis, in the 
example of packet Pi, shift register 44 shifts out two least significant bits, and shifts in two 
zeroes at its most significant bits. Consequently, at this point shift register 44 stores in its 
least sigruficant bit locations the annul word bits corresponding to packets P2 and P3 of 
instruction group G3 in the order as shown in Figure 7, and in the remaining more 
significant bit positions it stores zeros. Each of these bits is output to buffer 42 and thus 
form a part of bit group 46. 

Figure 6c illustrates the annul mask bits resulting in the second dock cycle 
foUowing the clock cycle in which the instructions of packet Pi are forwarded to execution 
units and potentiaUy executed (i.e., if there is no set annul bit for the instruction). More 
particularly, recaU that shift register 44 shifted out its two least significant bits in 
connection with the execution of packet Pi; as a result, in the following clock cycle as 
shown in Figure 6c, the bits in annul mask AM represent the bits of annul word AWl in 
the order from Figure 7 with the two least significant of those bits having been removed 
by the shift out operation. Thus, one may readily confirm that the bits AMi to AM^ in 
annul mask AM of Figure 6c correspond, in order, to the bits of annul word AWl of 
Figure 7 as pertaining to packet P2 and the four least significant annul word bits pertaining 
to packet P3. 

Figure 6c also illustrates the mapping bits written by the compiler into use map 48 
as pertaining to the possible execution of the instructions of packet P2. Specifically, from 
Figure 7, note that instructions 3, B2, 4, and C2 are scheduled for execution by fimctional 
units FUi, FU2, FU5, and FU7, respectively. As a restdt, the compiler sets the bit locations 
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in use map 48 corresponding to those functional units (i.e.; FUi, FU2/ FUs/ and FUy), Still 
further, because the compiler has, as described earlier, put instructions 3, B2, 4, and C2 in a 
successive order corresponding to the ordering of the functional units, then the number of 
least significant bits of annul mask AM equal to the number of instructions in packet P2 
5 (i.e., four instructioris and, hence, four annul mask bits) are mapped to fimctional units 
FUi, FU2, FU5, and FU7. More specifically, each of functional units FUi, FU2, and FU5 
receives an annul mask bit equal to 0 while functional tmit FU7 receives an annul mask bit 
equal to 1. Finally, and in responise to the values of the annul mask bits, each of functional 
tmits FUi, FU2, and FU5 executes their respective instructions 3, B2, and 4, while fimctional 
10 unit FU7 is disabled in response to the high annul mask bit and, thus, instruction C2 is not 
executed. 

To complete the example which has now been demonstrated in part in Figures 6b, 
^ 6c, and 7, Figure 6d illustrates the annul mask bits and use map bits resulting in the third 

'5 clock cycle, that is, following the clock cycles for potential execution of packets Pi and P2. 

15 With respect to the bits in annul mask AM, note that the previous packet, P2/ had four 
J, instructions and thus, NIP equals four and causes shift register 44 to shift out four least 

f"^ significant bits and to shift in a value of zero at its four most significant bits; these values 

1--^ pass through buffer 42 and form bit group 46, with the eight least significant bits passing 

to annul mask AM. Thus, in Figure 6d annul mask AM stores the six bits of annul word 
20 AWl from Figure 7 corresponding to packet P3 and in the order shown therein, and the 
two most significant bits are zero due to the earlier shifting in of a zero value by shift 
register 44 into its more significant bits. With respect to use map 48, its values have been 
set by the compiler to map the annul bits corresponding to the packet P3 instructions to the 
appropriate functional tmits. Thus, one skilled in the art may readily confirm that Figure 
25 6c illustrates a proper mapping of each annul mask bit, as corresponding to a packet P3 
instruction, to the appropriate functional imit. In response and given the preceding, it 
shottld be readily appreciated that functional units FU2 and FUe execute their respective 
instructions 7 and 8, while functional tmits FUi, FU4, FU5, and FUs do not execute their 
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respective instructions 5, 9, 6, and 10, that is, instructions 5, 9, 6, and 10 do not affect the 
architected state of the processor (i-e., they are annulled). 

Having now illustrated the preferred embodiment of shifting an annul word 
through shift register 44, an additional point may be made returning to Figure 3b. 

5 Specifically^ recall that method 20 processes an instruction group imtil a condition at a 
bottom level is detected by step 28. Recall further that this looping methodology wiU 
cause conditions at different levels of a code tree to be evaluated, and finally recall that it 
was noted that the method, for conditions that are not at the bottom level of the tree, wiU 
set annul bits either along the ^'THEN'' or ''ELSE" path relating to the condition. Ftirttier 

10 in this regard, it is now noted that for any instruction(s) in any packet(s) above that level, 
ttie annul bits corresponding to tiiose prior packet instructions will already have been 
shifted out by shift register 44. Accordingly, the annul bits corresponding to any packet 
preceding the instruction being evaluated are no longer an issue and, therefore, are not 
further altered by the method. 

15 Also in view of the preferred operation of system 40, note that other alternative 

embodiments are contemplated for suppressing instructions in response to an annxil word. 
One approach is to eliminate the use map 48 and to completely fiQ the annul mask for 
each cycle, that is, to couple a number of bits from the annul word to the armul mask 
where the number of bits equals the total nimaber of functional units, and to always map a 

20 given location in the annxil mask to a same corresponding fimctional unit. In this case, for 
a given clock cycle when an execution unit is not scheduled to execute, then the annul 
mask bit passed to it has no net effect (i.e., since the execution unit was already scheduled 
not to operate during the present clock cycle). Another approach is to keep track of the 
order of instructions in the instruction stream, so that the instruction of a packet is 

25 aimuUed by bit N-1 of the annul mask. However, given that there is otherwise no need to 
maintain a record of instruction ordering within a packet, this approach might lead to 
additional hardware which may not be desired in a given implementation. Still another 
approach, at the expense of additional annulling hardware, is to have an incoming N bit 
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annul word where its set bits are mapped only to those instructions that have not been 
annulled by a previous annul word, and merging this more recent annul word into an 
older annul word. While this alternative requires increased complexity, it allows 
increased range when axmulling over hierarchies of if-then-else trees. Note that for an 8- 
5 way VLIW, in the first clock cycle the new annul word would be logically OR'ed into only 
the bottom 8 bits of the previous anntd word. Higher bits could have an additional clock 
cycle to perform the merging of annul bits. 

Each of the various approaches set forth above ultimately provides an annul word 
that is translated to potentially suppress the operation of a functional tmit with respect to 

10 an assigned instruction. Further in this regard, note that the annul word therefore 
represents information about potentially not executing an instruction where this 
information is known at a time earlier than tiie time that a predication determination 
would be made with respect to the same instruction if predication were used. As a result, 
in addition to disabling a functional unit for a given clock cycle in response to a set annul 

15 word bit, an extension of the preferred embodiment may use the advance information of a 
set annul bit to power down otiier hardware that is known to be not needed because an 
instruction will be annulled. For example, in the case of predication, even though the 
predicate is ultimately fotmd to be false, the predicate information may come too late to 
prevent updating the two registers forming the inputs to an adder which would be used to 

20 perform an add (or subtract) if a predicate is found to be true; however, the annul word 
bits may be known early enough to avoid clocking these registers and thereby avoid 
dissipating the extra power that the adder would otherwise consume. 

As described earlier in connection with Figures 3a and 3b, in the preferred 
embodiment the analysis of an instruction group is performed at the compiler level by 
25 having the compiler form different annxxl words based on different possible outcomes of 
the condition(s) in the program tree. Given the existence of those annul words, the 
preferred embodiment further implements the present teachings by inserting into the 
instruction stream an instruction (or more than one instruction) that will execute either 
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concxirrently or after the condition to which it applies and in response that will provide 
the appropriate annul word corresponding to the actual outcome of the condition and to 
prepare the architecture to respond to the relevant annul word. For sake of reference, for 
the remainder of this document this instruction (i.e., that causes the aimul to be performed 
5 according to an annul word) is referred to as an annul instruction. The annul instruction, 
and its related annul word, may be created and associated with one another in various 
manners giving rise to numerous different embodiments, as detailed below. Before 
discussing those embodiments, note that regardless of the implementation, an additional 
preferred aspect arises with respect to the packet location of the annul instruction(s). 
10 Specifically, it is preferable for the compiler-inserted annul instruction(s) to commence its 
annulling operations (i.e., suppression of ii\structions) with instructions executed in the 
cycle after the packet which includes the annul instruction; in other words, it is preferable 

C§ that the annul instruction not affect any of the instructions in the same packet as the annul 
instruction, regardless of whether they precede or follow the annul instruction in the 

;£ 15 instruction stream, 

;^ Txxming now to various embodiments of the annul instruction and its related 

annul word, in a first embodiment, two constant-generating instructions are executed to 
La generate two corresponding 16-bit constants, where the two constants are then 
rL: concatenated to form a 32-bit annul word, and then the annul word is used in response to 
Q 20 an additional annul instruction. Alternatively, a load instruction may cause a load of a 32- 
bit annul word, such as from memory, followed by an annul instruction causing the 
loaded annul word to be used to selectively suppress execution of additional instructions. 
In a second embodiment, the annul word is an immediate operand included within an 
instruction; in this regard, note that many contemporary instructions include numerous 
25 bits, such as source identifiers, a destination identifier, an immediate bit, and others. 
However, to achieve the annul functionality, many of these bits would not be required 
and, thus, these additional bit locations could be used to embed an anniil word directly 
into the instruction. In this case, however, there is likely to be a limited ntmiber of 
available bits and, thus, the embedded annul word may be limited less than 32 bits (e.g., a 
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limit of 16 bits). In a third embodiment, the annul instruction provides an annul word of 
more than 32 bits, such as by specifying two 32-bit register sotxrces which, when 
combined, provide a total of 64 annul bits for up to 64 incoming instructions. This 
approach may likely require a load-double instruction (i.e., a 64-bit load) to produce the 64 

5 annulling bits prior to the actual annxxHing operation. In a fourth embodiment, the 
annulling instruction is predicated, and includes two different source registers, each 
having a different annul word based on the response to the predicate. For example, 
returning to instruction group G3, condition A3 at the top of the tree could be used as a 
predicate, where a first source register stores an annul word to be used if condition A3 is 

10 true and a second source register stores an annul word to be used if condition A3 is false. 
In a fifth embodiment, the annul instruction again is predicated as is the case in the fourth 
embodiment, but in the fifth embodiment only a single register source is used, where one 
half of the register source provides the annul word if tihe condition is true while the other 
half of the register source provides the annul word if the condition is false. In a sixth 

15 embodiment, the annul instruction includes an argument N which merely causes the next 
N instructions to be annulled, but imlike the preceding embodiments this embodiment 
necessarily requires that the sequence of the code is known and there is no mingling of 
code from outside of the block within the block (i.e., so that such mingled instructions are 
not wrongfully annulled). As a final and seventh embodiment, the instruction includes a 

20 predicate and a single source register. In this case, if the predicate is true the instructions 
corresponding to the I's in the source register are annulled while if tiie predicate is false 
the instructions corresponding to the O's in the source register are annulled. Further with 
respect to this final instruction embodiment, it includes an additional argument X that 
specifies and thereby possibly limits the nttmber of bits within the source register to be 

25 used. Specifically, note that if the bit capacity of the source register (i.e., annul word) is 
greater than the number of instructions in a particular group, then the register will store 
O's in its most significant bits corresponding to a lack of instructions for those bits - given 
this possibility, the argument X in this seventh embodiment is set to specify only those bits 
vsdthin the source register that correspond to actual instructions so that these more 
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significant bits are not wrongfully interpreted as applying to instructions and used to 
annul (or not annul) such instructions. 

Still further embodiments arise from the preceding given the trends in parallelism 
and latency. Specifically, in general, the number of instructions which it is useful to annul 

5 is a function of the branch latency and the nvimber of instructions which can be executed 
in parallel. The product of these two aspects is the preferable limit on the number of 
instructions it is worthwhile to annul rather than taking a branch. The trends in computer 
architecture lead to a gradual increase in both of these quantities. As a resxdt, in the future 
it is likely that it will be desirable to annul xmder a mask even larger than 64 bits. Still 

10 ftuther, as the present teachings are employed larger code blocks will become useful to 
implement using annulling instead of branching, and the use of hierarchies of annul 
instructions to implement hierarchies of if-fhen-else constructs will increase. Indeed, it 
may be predicted that a 16-way VLIW might have to do much more of this than an 8-way 
VLIW because branches are twice as expensive in terms of potential instructioT\s. 

15 A final consideration arises from the preferred annuUing methodologies of the 

present docxunent when viewed in the context of interrupt handling. Specifically, in the 
preferred embodiment, there are two manners of handling interrupts in the presence of 
pending instructions that are identified to be annulled (i.e., that have corresponding bits 
set in an annul word). As a first approach, when an interrupt is received the present annul 

20 word is saved into a register and then the annul word is cleared so that it does not affect 
the interrupt; thereafter, the stored annul word is restored upon returning from the 
interrupt by executing another annul instruction with the saved information as the data 
for the new annul instruction. As a second approach, interrupts may be disabled 
whenever the annul word has any non-zero bits (i,e., when at least one instruction aheady 

25 has been identified to be annulled). 

The discussion is now directed to a different application of the preferred 
embodiment where branch instructions are not the itnmediate focus, but instead the 
following demonstrates how the preferred embodiment also has beneficial use in the field 
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of what is referred to in the art as software pipelining. To illustrate software pipelining, 
consider the following two lines of code written in the C language and shown in Table 1: 



Code 


Line identifier 


FORj=0, j<L, j++ 


a1 


DD] = A[j] + BD]; 


a2 



Table 1 



The code of Table 1 represents a high level language loop to add a vector A to a vector B, 
5 both of length L, with the results stored in a vector D. 

Next, consider the following low level language mnemonics in Table 2, which 
represent a typical set of low level code to implement instructions al and a2 of Table 1: 



Mnemonic 


Line identifier 


Load R1 (with addend) 


b1 


Load R1 (with addend) 


b2 


Add R1, R2 


b3 


Store R3 


b4 



Table 2 



Instructions bl through b4 represent a single loop to add an element of a vector to an 
10 element of another vector and to store the result; more particularly, instructions bl and b2 
load the addends into registers Rl and R2, instruction b3 adds those addends, and 
instruction b4 stores the result in a register R3. 

By way of additional backgrotmd, assume that instructions bl through b4 are 
executed by a processor which has the following common contemporary attributes. First, 
15 assume that the processor reqtures five clock cycles to perform a load instruction. Second, 
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assume that the processor includes two different load units. Given these assxnnptions, 
note that instructions bl and b2 may occur simultaneously, but instruction b3 must wait 
for instructions bl and b2 to complete, that is, b3 must wait the five clock cycles associated 
with instructions bl and b2. Moreover, if instructions bl through b4 are to occur 
5 numerous times, such as is the case if L equals a large number in instruction al, then this 
same delay occurs for each loop and becomes increasingly more costly in terms of 
processor efficiency. To reduce this potential inefficiency, software pipelining has been 
implemented in the art, as further detailed below. 

Figure 8 illustrates instructions bl through b4 as appHed to a loop where L equals 
10 128, and implemented using software pipelining. As a matter of introduction, note that 
software pipelining is often used for software looping, and attempts to optimize the 
number of instructions executed per clock cycle, where different instructions in a given 
clock cycle may pertain to different iterations of the loop. Turning to Figure 8 by way of 
example, in each row it illustrates which of instructioiis bl through b4 are executed for a 
15 given clock cycle, where the subscript of each of those instructions indicates the 
corresponding loop number that pertains to the given instruction. For example, looking at 
clock cycle 0, instructions bl and b2 are both executed for the instance of the loop value 
equal to 0 (i.e., j=0 in instruction al, above). Accordingly, during clock cycle 0, two load 
instructions commence for the loop value equal to 0, and these load instructions (i.e., bl 
20 and b2) are shown in Figure 8 with a subscript value of 0. Similarly, in clock cycle 1, two 
load instructioiis commence for the loop value equal to 1, and this same pattern continues 
through clock cycle 4 (and beyond as detailed later). 

In clock cycle 5 of Figure 8, note lhat five clock cycles have elapsed since the two 
load instructions associated with loop 0 corrmienced. Further, recall that the example 
25 assumes that a load instruction requires five clock cycles to complete. Therefore, as of 
clock cycle 5, the loaded addends from loop 0 are available in registers to be added to one 
another. As a restdt and as is shown to occur during clock cycle 5 by the illustration of 
instruction b3 (i.e., ADD Rl, R2), these addends are summed. Further, because the add 
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instruction in clock cycle 5 is therefore associated with the loop value of 0, then instruction 
b3 is shown to have a subscript value of 0. Finally, assume that the add instruction in 
clock cycle 5 requires only a single clock cycle to produce its sum. 

Turning next to clock cycle 6 in Figure 8, note that the first three instructions 
5 shown therein follow the patterns illustrated earlier, that is, two load instructions 
commence and an add instruction is executed using the addends loaded by instructions 
which began five clock cycles earlier. In addition and as shown in the last entry of the row 
corresponding to clock cycle 6, instruction b4 (i.e., STORE R3) is also executed, where 
instruction b4 stores the sum coixunenced by loop 0 and stunmed in the preceding clock 
10 cycle 5. Thus, by the end of clock cycle 6, the first loop (i.e,, j=0) of the instructions al and 
a2 is complete; however, due to the pattern having now been introduced, as of that same 
time the load instructions through loop 6 have begun, and the store instructions through 
loop 1 are complete. 

Given the illustration through clock cycle 6 note that, from clock cycle 6 through 
15 clock cycle 127, in each such clock cycle there is a same pattern; in other words, in each 
such clock cycle two load instructions begin, an add instruction is executed using the 
addends corresponding to the load instructions commenced five clock cycles earlier, and a 
store instruction is executed using the using the addends corresponding to the load 
instructions commenced six clock cycles earlier. In other words, from clock cycle 6 
20 through clock cycle 127, the instructions may be represented as: 

blN b2N b3N-5 b4N-6 

From this pattern, it may be seen how the instructions pass in a staggered fashion 
according to different loop values, and for this reason this process is akin to a pipeline and 
gets its name of software pipelining. Also with respect to terminology in the art, note that 
25 the time period including clock cycles during which each instruction (bl through b4) is 
executed is referred to as the code loop. Further, the time period consisting of the clock 
cycles preceding that time period (e.g., clock cycles 0 through 5) and during which only 
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some of the loop instructions are executed is referred to in the art as the prologue. Lastly, 
and as detailed below, after the code loop eventually all the load instructions for the entire 
loop are complete, but remaining clock cycles are required to complete the instructions 
(e.g., add and store) for each loop; this remaining time period is referred to in the art as the 
5 epilogue. 

Figure 8 also illustrates the epilogue which begins in clock cycle 128. More 
particularly, as of clock cycle 128, each load instruction for the loop has already begun 
and, thus, no new load instruction (i.e., bl or b2) is shown. However, also as of clock cycle 
128, the already-commenced load instructions are working toward completing, or have 

10 completed, loads with respect to addends that once loaded wiE be summed and then 
stored. For example, in clock cycle 128, the addends loaded for loop 122 are now available 
for summing and, thus, during clock cycle 128 instruction b3 adds those addends (shown 
by b3i22). As another example, in clock cycle 128, the addends loaded for loop 121 have 
been loaded and summed and, thus, are now available for storing; accordingly, during 

15 clock cycle 127 instruction b4 stores that sum of those addends (shown by b4i2i). This 
process therefore repeats through clock cycle 132. Finally, in clock cycle 133, the sums for 
loop values 0 through 126 have been calculated and stored, but also as of that time the 
addends loaded for loop 127 have been loaded and summed and, thus, are now available 
for storing; accordingly, during clock cycle 133 instruction b4 stores that sum of those 

20 addends (shown by b4i27) . 

The preceding demonstrates the advantage of software pipelining in that it is 
shown how during each clock cycle in the loop code all instructions in the loop are 
executed while taking into account the delays of earlier instructions. Indeed, due to this 
advantage, software pipelining is very commonly used, particularly for instances of large 
25 vector or array operations (e.g., pixels on screens, filter coefficients, and so forth). 
However, the present inventor has recogruzed that notwithstanding this benefit, there also 
may be drawbacks to software pipelining, and these drawbacks are considerably reduced 
by applying the preferred embodiment, as detailed earlier, to the context of software 
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pipelining. To further demonstrate these aspects, the drawbacks arising from software 
pipelioing are first discussed below, followed by an application of the preferred 
embodiment to software pipelining in order to reduce the effects of such drawbacks. 

The drawback from software pipelining arises from its use of program memory (or 

5 instruction) space in a processor. More particularly, it is well known that processor 
memory is a key contributor to processor cost and complexity and, thus, design 
considerations often limit the amoxmt of such memory; further therefore, if a large 
program must be accommodated by a processor, then its instruction memory must be 
more complex and more expensive. Applying these principles to the instructions in 

10 Figure 8, note that the prologue consists of thirteen instructioiis. Thus, each of these 
instructions may be thought of as requiring its own space in the instruction memory (i.e., 
an addressable space so that the instruction may be fetched and executed). As a result, 
thirteen memory locations must be available for the prologue in the example of Figure 8. 
Similarly, the epilogue consists of eleven instructions and, thus, eleven memory locations 

15 must be available for the epilogue in the example of Figure 8. Lastly, however, note that 
the loop code is much more efficient in its use of memory space. Particularly, since each 
line of the loop code consists of an identical set of instructions, then typically that set of 
instructions require space in memory, and a few additional instructions implement a loop 
to repeatedly execute just that set of instructions for the appropriate nimiber of iterations; 

20 thus, in the example of Figure 8 only four memory spaces are required for the four 
instructions per clock cycle. For each iteration of this loop, and given the clock cycle delay 
described earlier for the present example, then two loads commence, an add executes 
using the addends which are available and, which, given the five clock cycle delay are 
therefore those relating to the load instructions commenced five cycles earlier, and a store 

25 executes using the stmi which is available and, which, given the five clock cycle delay are 
therefore those relating to the load instructions commenced six cycles earlier. To 
implement this loop, there is also required an initialization such as a setting of a counter, a 
decrement of that coxmter for each loop in the loop code, and a predicated branch at the 
' end of the loop to return to the beginning of the loop xmtil the coxmter reaches an 
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appropriate count. As a restdt, to implement the loop code of Figure 8 in memory space 
requires a total of four instructions for those shown in each line, as well as an initialization 
instruction, a decrement instruction, and a branch instruction, thereby resulting in a total 
of only seven instructions and seven memory spaces. Given the preceding, note that 
5 relative amount of memory space required for the loop code is less than that for either the 
prologue or the epilogue, and is particularly low given that the loop code once complete 
for all of its iterations acco^mts for many more instruction executioris than does either the 
prologue or the epilogue. 

Figure 9 illustrates instructions bl through b4 of Figure 8 as again appHed to a loop 
10 where L equals 128 and implemented using software pipelining, but in Figure 9 the 
software pipelining is improved because the preferred embodiment is also appHed so that 
certain instructions may be annulled. More particularly, note that in every clock cycle of 
Figure 9, all four instructions used in the loop code of Figure 8 are scheduled for 
execution. As an important distinction from the prior art, however, some of the 
15 instructions in Figure 9 are annulled using the preferred embodiment described earlier, 
where the armuUed instructions are illustrated in Figure 9 using an M' for the subscript 
of the instruction. Indeed, the annulled instructions may be used in clock cycles 
corresponding to either or both of the prologue and epilogue from Figure 8, as further 
detailed below. 

20 Looking to a comparison of the prologue of Figure 8 and the same clock cycles of 

that prologue as shown in Figure 9, and looking by way of example to clock cycle 0, the 
four instructions bl, b2, b3, and b4 are scheduled to execute. However, note that 
instructions b3 and b4, as shown by their subscripts (i.e,, b3A and b4A), pass through 
the instruction pipeline but are annulled so that they do not affect the architected state of 

25 the processor. Thus, by comparing clock cycle 0 in Figures 8 and 9, one skilled in the art 
will appreciate that in both cases instructions bio and b2o are executed, and the effect on 
the architected state of the processor is no different for either figure due to the annulling 
steps taken with respect to instructions b3 and b4 in Figure 9. Still further, recall from 
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Figure 8 that the prologue consists of the instructions in clock cycles 0 through 5, Using 
the preferred embodiment the same instructions of the Figure 8 prologue may be 
executed in clock cycles 0 through 5 of Figure 9, while at the same time armulling one or 
more additional instructions during each of those clock cycles. 

5 Looking to a comparison of the epilogue of Figure 8 and the same clock cycles of 

that epilogue as shown in Figure 9, and looking by way of example to clock cycle 128, the 
four instructions bl, b2, b3, and b4 are again scheduled to execute. However, instructions 
bl and b2, as shown by their '"A" subscripts (i.e., blA and b2A)/ pass through the 
instruction pipeline but are annulled so that they do not affect the architected state of the 

10 processor. Thus, by comparing clock cycle 128 in Figures 8 and 9, one skilled in the art 
will appreciate that for both Figures instructions b3i23 and b4i22 are executed, and the effect 
on the architected state of the processor is no different for either figure due to the 
annulling steps taken with respect to instructions bl and b2 in Figure 9. RecaU also from 
Figure 8 that the epilogue consists of the iiistructions in clock cycles 128 through 133. 

15 Using the preferred embodiment, the same instructions of the Figure 8 epilogue may be 
executed in clock cycles 128 through 133 of Figure 9, while at the same tune annulling one 
or more additional instructions during each of those clock cycles. 

From the preceding, one skilled in the art should now appreciated that Figure 9 
illustrates that software pipelining may be modified by implementing the preferred 

20 embodiment. More particularly, for a software loop which previously gave rise to prior 
art software pipelining, the preferred embodiment is implemented such that for all clock 
cycles of the loop all instructions in the loop code are scheduled to execute. Additionally, 
during certain ones of those clock cycles one or more of those instructions are annulled 
(i.e., by setting the appropriate bits in the annul word). The particular instruction(s) which 

25 are annulled may be determined based on the relationship of the given iteration to the 
total number of iterations required to complete the loop. For the example of Figure 9, for 
example, two instructions are annulled during clock cycles 0 through 4 of the 134 clock 
cycles, one instruction is annulled during clock cycle 5 of the 134 clock cycles, two 



38 



TI-26581 



PATENT 



instructions are annulled during clock cycles 128 through 132 of the 134 clock cycles, and 
three instructions are annulled during clock cycle 133 of the 134 clock cycles. 

To further demonstrate the scope of what is illustrated in Figure 9, note that the 
instructions shown therein may be executed using the following instructions shown in 
Table 3: 



Mnemonic 


Line identifier 


Load R1 (with 1^ annul word) 


c1 


Annul 


c2 


Set counter AO (branch counter) 


c3 


Set counter A1 (annul counter) 


c4 


Load R1 (with addend) 


c5 


Load R1 (with addend) 


c6 


Add R1, R2 


c7 


Store R3 


c8 


Decrement AO 


c9 


Decrement A1 


c10 


[A0?^0], branch c5 


c11 


[A1=0]. Load R1 (with 2"^^ annul word) 


c12 


[A1=0], Annul 


c13 



Tables 



The instructions of Table 3 are now explored in greater detail, and reference also is made 
in this discussion back to Figure 9. Further, for sake of comparison, the instructions are 
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discussed in groups which approximate the operations that fall into each of the prologue, 
loop code^ and epilogue of the prior art. 

Looking to the beginning of Table 3, instruction cl loads a first annul word into an 
appropriate register. The bits of the loaded annul word are appropriately set to annul 

5 those instructions shown as annulled in clock cycles 0 through 5 of Figure 9. In other 
words, these armuUed instructions are those which were not in the pipeline in the 
prologue of Figure 8. Further, because there are a total of eleven instructions to be 
annulled, then the annul word will therefore have eleven corresponding set bits. 
Instruction c2 is the annul instruction, which thereby moves the register-stored annul 

10 word into the appropriate hardware, that is, the annxil word may then be treated as anntd 
word AW3 in Figure 6a. Instruction c3 sets a first counter designated AO, where this 
coimter is used as further apparent below to define the total number of clock cycles 
required to complete aU the clock cycles in Figure 9 and, thus, in the present example 
counter AO is set to 134. Instruction c4 sets a second counter designated Al, where this 

15 coxmter is used as further apparent below to define the total number of clock cycles 
required to complete all instructions in Figure 9 which precede what would be the 
epilogue in Figure 8 and, thus, in tiie present example coimter Al is set to 128. At this 
point, therefore, the load, add, and store operations are ready to begin as further explored 
below. 

20 The first iteration of instructions c5, c6, c7, and c8 represents what is shown as 

clock cycle 0 in Figure 9. More particularly, instructions c5 and c6 cause the execution of 
bio and b2o. However, due to the annul word load and implementation of instructions cl 
and c2, then instructions c6 and c7 are anmxUed, as corresponding to annulled instructions 
b3A and b4A of clock cycle 0 in Figure 9. Instructions c9 and clO decrement counters AO 

25 and Al, respectively. Thus, at this point, clock cycle 0 of Figure 9 is complete and the 
process is directed to clock cycle 1 of Figure 9. Further in this regard, instruction cll is 
predicated to execute only if coxmter AO has not reached 0. At this point in the example, 
cotmter AO has only been decremented once and thereby stores a value of 133; 
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accordingly, the predicate is not satisfied and the instruction flow is returned to 
instruction c5. One skilled in the art will appreciate from this return branch operation that 
for each clock cycle until counter AO reaches a value of 0, then instructions c5, c6, c7, and 
c8 are scheduled for execution during that clock cycle. Moreover, because of the earlier- 
5 loaded 11-bit annul word, then a total of 11 instructions are annulled during these 
repeated clock cycles, where the annulled words are those shown with an K' subscript in 
clock cycles 0 through 5 of Figure 9. 

Once counter AO is decremented to a value of 128, then instructions c3, c4, c5, and 
c6 have been scheduled for execution and executed, if not annulled, a total of six tunes, 
10 thereby concluding clock cycles 0 through 5 in Figure 9. Also at this time, counter Al, 
having been decremented six times, equals a value of 122. Further, by clock cycle 6, there 
are no remaining set annul word bits and, thus, until coxmter AO reaches 6 the Table 3 
code wiU schedule and execute each of instructions c5, c6, c7, and c8, with no annulling of 
those instructions. 

15 When cormter AO reaches a value of 6, cotmter Al will at that time have been 

decremented to a value of 0. As a result, the predicate of instructions cl2 and cl3 is met; in 
response, instruction cl2 loads a second annul word into an appropriate register, where 
the bits of the second annul word are appropriately set to annul those instructions shown 
as annulled in clock cycles 128 through 133 of Figure 9. Because there are a total of 13 

20 instructions to be annulled, then the annul word will therefore have 13 corresponding set 
bits. Instruction cl3 is an annul instruction which moves the second register-stored anntil 
word into the appropriate hardware, again represented by annul word AW3 in Figure 6a. 

Concluding the present example, at this point coimter AO equals 6 and counter Al 
equals 0. Accordingly, instruction cll returns the flow to instructions c5, c6, c7, and c8. 
25 Thus, the next iteration of instructions c5, c6, c7, and c8 represents what is shown as clock 
cycle 128 in Figure 9. More particularly, instructions c7 and c8 cause the execution of b3i23 
and b4i22. However, due to the second annul word load and implementation of 
instructions cl2 and cl3, then instructions c5 and c6 are annulled, as corresponding to 



41 



TI-26581 



PATENT 



annulled instructions blA and IoIa of clock cycle 128 in Figure 9, Instructions c9 and clO 
decrement counters AO and Al, leaving them will values of -1 and 5, respectively. Thus, 
the predicate of instruction cll is still not met and, therefore, the process repeats for 
another five clock cycles, that is, through clock cycle 133 of Figure 9. Finally, after those 
5 five clock cycles, cotmter AO has been decremented so that it now stores a value of 0; 
accordingly, the predicate of instruction cll is met and therefore no branch is taken, 
thereby completing the loop and instructions of Table 3. 

Having demonstrated the methodology of Table 3, it is now noted how it renders a 
more efficient operation than software pipelining in the prior art and, more particularly, 
10 how the preferred embodiment when implemented with software pipelining improves 
the usage of instruction memory space. Recall that the number of instructions required for 
iO the software pipelining example in Figure 8 consisted of thirteen prologue instructions, 

L,^„ seven loop code instructions, and eleven epilogue instructions for a total of tiiirty-one 

instructions. In contrast. Table 3 demonstrates how appropriately located and executed 
::p 15 annul instructions, along with additional instructions, may implement all of the Figure 9 
operations using a total of thirteen instructions. Thus, by implementing the preferred 
embodiment in software pipelining for the present example which contrasts Figure 9 with 
ki: Figure 8, there is a reduction of eighteen total instructions from the thirty-one required of 
:;L^ the prior art to the tiiirteen required in the preferred embodiment; in other words, for this 
O 20 example, there are 58 percent less instructions used. Consequently, there is likewise a 58 
percent reduction in the amotmt of required instruction memory space. As mentioned 
earlier, any such reduction improves complexity and cost and, thus, it now has been 
shown how the preferred embodiment may have a dramatic effect in this regard. 

As a final consideration of the preceding, note further iiiat the code of Table 3 is 
25 only by way of example, and its ordering is also to logically demonstrate the example with 
it xmderstood that such code and/ or ordering may be modified according to various 
considerations. For example, different optimization techniques may be applied to re- 
arrange some of the code. As another example, in many processors, there is a delay 
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associated with the branches; thus, by way of example in such a case, the branch of 
instruction cll may be placed by the compiler earlier in the code so that its delay causes 
the actual branch to be taken (or not taken) at the appropriate time. 

Figure 10 illustrates a block diagram of a processor 50 in which system 40 as well 
5 as the previously described inventive methodologies may be implemented, thereby 
permitting a more efficient operation with respect to either or both of avoiding branch 
instruction complexities and enhancing software pipelining. Processor 50 is preferably a 
single integrated circuit and is shown in block form so as to simplify the illustration and 
discussion in the context of the instructions described above, while one skilled in the art 
10 will readily appreciate that additional details arise from the blocks shown as pertaining to 
processor operation and functionality. Further/ processor 50 t3rpifies a processor from the 
TMS320 C6000 series of processors commercially available from Texas Instrxmnents 
Incorporated, including the TMS320C62x/ C67x digital signal processors. 

Turning to processor 50, it includes a program memory 52, which on some devices 
15 can be used as a program cache. Processor 50 also includes a data memory 54. Memories 
52 and 54 are coupled to communicate with a central processing unit ("CPU") 56, which 
includes a pipeline 58 having various stages shown as a program fetch unit 58a, an 
instruction dispatch unit 58b, and an instruction decode tmit 58c. The pipeline of CPU 56 
further includes two data paths shown as path A and path B, where each data path has a 
20 corresponding set of four functional tmits (LI, SI, Ml, and Dl for path A and L2, S2, M2, 
and D2 for path B). Briefly, the operational functionality of the functional units is set forth 
in the following Table 4, where additional functionality may be added or removed from 
each vmit according to a given implementation: 



Functional 
Unit 


Fixed-point operations 


Floating-point operations 


L 


32/40-bit arithmetic and 
connpare operations 

Leftmost 1 or 0 bit counting 
for 32 bits 

Normalization count for 32 


Aritlimetic operations 

DP^SP, INT-^DP, 
INT-^SP 

conversion operations 
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and 40 bits 

32-bit logical operations 




s 


32-bit aritlimetic operations 

32/40-bit shifts and 32-bit 
bit-field operations 

'^?-hit looical oneration^ 
Branches 

Constant generation 

Register transfers to/from 
the control register file (S2 
only) 


Compare 

Reciprocal and reciprocal 
square-root operations 

SP^DP conversion 
operations 


M 


16 by 16 multiply operations 


32 by 32 bit fixed-point 
multiply operations 

Floating-point multiply 
operations 


D 


32-bit add, subtract, linear 
and circular address 

calculation 

Loads and stores with a 5- 
bit constant offset 

Loads and stores with 15-bit 
constant offset (D2 only) 


Load doubleword with 5-bit 
constant 

offset 



Table 4 



Each set of functional units may commiuiicate with a corresponding data path 
register file (shown as Register file A and Register file B), where each register file includes 
32 32-bit registers. While not shown some of these communications also include cross- 

5 coupled paths whereby some functional imits from path A may read Register file B while 
some fimctional tmits from path B may read Register file A. CPU 56 also includes 
additional supporting hardware, including a control register 60, control logic 62, test logic 
64, emulation logic 66, and interrupt logic 68. Processor 50 also may include additional 
blocks such as a direct memory access (''DMA'')/extemal memory interface ("EMIF'') 

10 block 70 for performing the functions corresponding to these identifiers. Processor 50 also 
includes a peripheral block 72 which may support connection to various peripherals. 
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including by way of example, timers, serial port(s), and a host-port interface. Finally, 
processor 50 includes a power down logic block 74 that can halt CPU activity, peripheral 
activity, and phase locked loop (PLL) activity to reduce power consumption. 

The operation of processor 50 is now described in connection with the aspect of 
5 instruction treatment in the pipeline so that it may be further appreciated how the 
inventive annul circuits, systems, and methods detailed above provide their functionality 
in processor 50, again by way of example. Together, program fetch tinit 58a, instruction 
dispatch unit 58b, and instruction decode imit 58, can deliver up to eight 32-bit 
instructions to the functional units every CPU clock cycle. The processing of the 
10 instructions occurs in each of the two data paths (A and B), and recall each of these paths 
contains four functional tinits (L, S, M, and D) and 32 32-bit general-purpose registers. To 
further illustrate the pipeline operation of processor 50, below such operation is described 
relative to the 'C62x by way of example. 

Looking to fetch tmit 58a, it uses a fetch packet of eight instructions. All eight of 
15 the instructions proceed through fetch processing together, which consists of four phases 
(program address generate phase, program address send phase, program access ready 
wait phase, and program fetch packet receive phase). Dtiring the program address 
generate phase, the program address is generated in the CPU. In the program address 
send phase, the program address is sent to memory. In the program address send phase, a 
20 memory read occurs. Finally, in the program address send phase, the fetch packet is 
received at the CPU. 

Looking to instruction dispatch unit 58b and instruction decode ttnit 58c, in 
dispatch unit 58b the fetch packets are split into execute packets. Execute packets consist 
of one instruction or from two to eight parallel instructions. Dispatch imit 58b also assigns 
25 the instructions in an execute packet to the appropriate functional xmits. In the operation 
of instruction decode ttnit 58c, the source registers, destination registers, and associated 
paths are decoded for the execution of the instructions in the functional units. Thereafter, 
for a given clock cycle, each functional tmit that was assigned an instruction may execute 
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its corresponding instruction, where it now shotdd be apparent that such execution will 
occur in the preferred embodiment only if the annul bit corresponding to the assigned 
instruction, if any, is not set; given that an execute packet may include up to eight 
instructions, then in a single clock (and execution) cycle, these up to eight instructions may 
5 be executed (assuming cleared annul bits). If an execute packet has less than eight 
instructions, the remaining slots of the packet that do not have a corresponding instruction 
are treated as no operation instructions (''NOPs'')/ ai^d the NOP(s) is not dispatched to a 
functional tmit because there is no execution associated with it. 

Execution in processor 50 is broken down into five phases to accommodate certain 
10 instructions. However, for most instructions they require only one of these phases to 
execute. For example, for a so-caUed single cycle instruction, it executes in one phase in 
which it computes a result and writes the result to a register. As another example, for a 
multiply instruction, in a first execute phase it reads operands and begins its computation 
and in a second execute phase it computes a result and writes the result to a register. As 
15 stiU another example, for a load instruction, it executes in five phases, which perform the 
following steps, in order: (1) compute address; (2) send address to memory; (3) access 
memory; (4) send data back to CPU; and (5) write data into register. 

The preferred embodiments discussed above have been shown to include a system 
whereby an annulled instruction does not affect the architected state of a processor, and 

20 this aspect may be further shown by way of example given processor 50 of Figure 10, 
Specifically, an architected state of a processor is generally known in the art, and by way 
of example is the state of bits of the items in Figure 10 including memories 52 cind 54, 
register file A and register file B, as well as a program coimter (not explicitly shown) and 
any special control registers (which may be included in control registers 60). Accordingly, 

25 in the preferred embodiment, when an instruction is annulled, it is not permitted to 
change the bit state or states in any of these items. Still other examples based on device 
types and configurations will be ascertainable by one skilled in the art. 
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From the above, it may be appreciated that the present embodiments provide for 
allowing processor instructions to enter into the processor pipeline, but then act in 
response to an annul word to prevent selected ones of those instructions from affecting the 
architected state of the processor. Further, while the present embodiments have been 

5 described in detail, various substitutions, modifications or alterations could be made to the 
descriptions set forth above without departing from the inventive scope. Indeed, various 
examples to alternative methodologies have been provided above. In addition, as another 
example, while the preferred implementation and resulting functionality is shown as 
implemented in system 40, other approaches may be derived by one skilled in the art. As 

10 another example, while suppressing operation of an execution tinit has been shown as the 
preferred approach for preventing an instruction from changing liie architected state of 
the processor, other approaches may include suppressing operation of other portions of 
the processor pipeline so that an instruction which is desired to be annulled is not allowed 
to alter the architected state of the processor. As yet another example, avoiding branch 

15 complexity and improving software pipelining have been shown as two methods wherein 
the preferred embodiment proves useful, but still others may become apparent to one 
skilled in the art. Lastly, while the processor of Figure 10 provides an example of the type 
of processor where the present circuits, systems, and corresponding functionality may be 
implemented, numerous other processors could likewise implement the technology taught 

20 herein. Given these additional examples, one skilled in the art should further appreciate 
the inventive scope, which is defined by tiie following claims. 
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CLAIMS 

1. A processor having a changeable architected state, comprising: 
instruction memory for storing instructions; 

an instruction pipeline, wherein an instruction which passes entirely through the 
pipeline alters the architected state and wherein tiie pipeline comprises circmtry for 
fetching instractions from the instruction memory into the pipeline; 

circuitry for storing an annul code corresponding to instructions in the pipeline; 

and 

circuitry for preventing one or more selected instructions in the group from 
altering the architected state in response to the annul code. 

2. The processor of claim 1: 

wherein the instruction pipeline further comprises a plmality of execution units; 

and 

wherein one of more the plurality of execution tmits receives a corresponding 
instruction for executing the corresponding instruction in a given clock cycle. 

3. The processor of claim 2: 

wherein the annul code comprises a pltirality of bit states; 

wherein the circuitry for preventing one or more selected instructions in the group 
from altering the architected state comprises circuitry for coupling the plurality of bit 
states to respective ones of the plurality of execution tmits; 

wherein in response to a bit state being a first state the execution unit to which the 
bit state is coupled does not execute the corresponding instruction in the given clock cycle; 
and 

wherein in response to a bit state being a second state different than the first state 
the execution unit to which the bit state is coupled does execute the corresponding 
instruction in the given clock cycle. 
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4. The processor of claim 3 wherein the plurality of execution txnits comprises 
a load/ store unit, a multiply vinit, an ALU unit and a shift unit 

5. The processor of claim 3: 

wherein the plurality of execution tinits are operable such liiat in a given clock 
cycle an integer number N of the plurality of execution vinits are scheduled to execute; and 
wherein the circuitry for coupling the plurality of bit states to respective ones of 
5 the plurality of execution units comprises circtdtry for coupling only the integer number N 
of the plurality of bit states to the plurality of execution units which are scheduled to 
execute in the given clock cycle. 

6. The processor of claim 5: 

wherein the instructions corresponding to the annul code comprise: 

a first group of one or more instructions logically arranged after a 
conditional instruction and to be executed if the condition is satisfied; 
5 a second group of one or more instructions logically arranged after the 

conditional instruction and to be executed if the condition is not satisfied; 

wherein the circuitry for preventing prevents the first group of instructions from 
altering the architected state in response to the annul code if the condition is not satisfied; 
and 

10 wherein the circuitry for preventing prevents the second group of instructions 

from altering the architected state in response to the annul code if the condition is 
satisfied. 

7. The processor of claim 5: 

wherein the instructions corresponding to the annul code comprise instructions 
corresponding to a software loop scheduled to execute for an integer M number of 
iterations; and 

5 wherein during a given iteration the circuitry for preventing prevents one or more 

of the instructions corresponding to the annul code from altering the architected state in 
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response to the annul code and based on a relationship of the given iteration to the integer 
M number of iterations, 

8. The processor of claim 3: 

wherein the instructions corresponding to the annul code comprise instructions 
corresponding to software loop scheduled to execute for an integer M number of 
iterations; and 

wherein during a given iteration the circuitry for preventing prevents one or more 
of the instructions corresponding to the annul code from altering the architected state in 
response to the annul code and based on a relationship of the given iteration to the integer 
M number of iterations. 

9. The processor of claim 3: 

wherein the group of instructions corresponding to the annul code comprise: 

a first group of one or more instructions logically arranged after a 
conditional instruction and to be executed if the condition is satisfied; 

a second group of one or more instructions logically arranged after the 
conditional instruction and to be executed if the condition is not satisfied; 

wherein the bit states corresponding to the first group are set to the first state and 
the bit states corresponding to the second group are set to tiie second state if the condition 
is not satisfied; and 

wherein the bit states corresponding to the first group are set to the second state 
and the bit states corresponding to the second group are set to the first state if the 
condition is satisfied. 

10. The processor of claim 1 wherein the annul code is generated in response 
to one or more constant generating instructions. 

11. The processor of claim 1 wherein the annul code is loaded from a memory. 
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12. The processor of claim 1 wherein the annul code is an immediate value in 
an instruction passing through the pipeline. 

13. The processor of claim 1 wherein the annul code comprises 32 bits. 

14. The processor of claim 1 wherein the annul code comprises more than 32 

bits. 

15. The processor of claim 1: 

wherein the annul code comprises 64 bits; and 

wherein the aimul code is formed in response to two thirty-two bit values. 

16. The processor of claim 1: 

wherein the annul code is loaded in response to an instruction having a condition 
predicate; 

wherein the annul code comprises a first annul code in response to the condition 
predicate being satisfied; and 

wherein the annul code comprises a second annul code in response to the 
condition predicate not being satisfied. 

17. The processor of claim 16: 

and further comprising a first register and a second register; 
wherein the first aimul code is stored in the first register; and 
wherein the first annul code is stored in the second register. 

18. The processor of claim 16: 
and further comprising a register; 

wherein the first annul code is stored in one-half of the register; and 
wherein the second annul code is stored in one-half of the register. 



51 



TI-26581 



PATENT 



19. The processor of claim 1: 

wherein an annul instruction passing through the pipeline specifies an integer N; 

and 

wherein the annul code is formed in response to the integer value N such that the 
circuitry for preventing prevents N successive instructions in the pipeline from altering 
the architected state. 

20. The processor of claim 1 : 
and further comprising a register; 

wherein the register stores the annul code which comprises a set of bits having a 
first logical value and a set of bits having a second logical value; 

wherein the annul code is loaded in response to an instruction having a condition 
predicate; 

wherein the circuitry for preventing prevents instructions corresponding to the 
bits having a first logical value from altering the architected state in response to the 
condition predicate being satisfied; and 

wherein the circuitry for preventing prevents instructions corresponding to the 
bits having a second logical value from altering the architected state in response to the 
condition predicate not being satisfied, 

21. The processor of claim 1 and further comprising circuitry for storing a 
portion of the annul code in response to receipt of an interrupt. 

****** 
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Processor With Annul Under Mask Technology For Improved Branch Efficiency 

ABSTRACT OF THE DISCLOSURE 

A processor (50) having a changeable architected state. The processor includes an 
instruction memory (52) for storing instructions. The processor also includes an 
instruction pipeHne, where an instruction which passes entirely tiirough the pipeline alters 
the architected state. Further, the pipeline comprises circuitry for fetching (58aa) 
instructions from the instruction memory into the pipeline. The processor also includes 
circuitry for storing an annul code (46) corresponding to instructions in the pipeline. 
Finally, the processor includes circuitry for preventing (FUi through FUs) one or more 
selected instructions in the group from altering the architected state in response to the 
annul code. 
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